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Abstract. No quantum measurement can give full information on the state of a quantum system; 
hence any quantum feedback control problem is neccessarily one with partial observations, and can 
generally be converted into a completely observed control problem for an appropriate quantum filter 
as in classical stochastic control theory. Here we study the properties of controlled quantum filtering 
equations as classical stochastic differential equations. We then develop methods, using a combination 
of geometric control and classical probabilistic techniques, for global feedback stabilization of a class 
of quantum filters around a particular eigenstate of the measurement operator. 
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1. Introduction. Though they are both probabilistic theories, probability the- 
ory and quantum mechanics have historically developed along very different lines. 
Nonetheless the two theories are remarkably close, and indeed a rigorous develop- 
ment of quantum probability |18| contains classical probability theory as a special 
case. The embedding of classical into quantum probability has a natural interpre- 
tation that is central to the idea of a quantum measurement: any set of commuting 
quantum observables can be represented as random variables on some probability 
space, and conversely any set of random variables can be encoded as commuting ob- 
servables in a quantum model. The quantum probability model then describes the 
statistics of any set of measurements that we are allowed to make, whereas the sets of 
random variables obtained from commuting observables describe measurements that 
can be performed in a single realization of an experiment. As we are not allowed to 
make noncommuting observations in a single realization, any quantum measurement 
yields even in principle only partial information about the system. 

The situation in quantum feedback control ^3 is thus very close to classical 
stochastic control with partial observations [Sj- A typical quantum control scenario, 
representative of experiments in quantum optics, is shown in Fig. 11.11 We wish to 
control the state of a cloud of atoms, e.g. we could be interested in controlling their 
collective angular momentum. To observe the atoms, we scatter a laser probe field 
off the atoms and measure the scattered light using a homodyne detector (a cavity 
can be used to increase the interaction strength between the light and the atoms). 
The observation process is fed into a controller which can feed back a control signal 
to the atoms through some actuator, e.g. a time-varying magnetic field. The entire 
setup can be described by a Schrodinger equation for the atoms and the probe field, 
which takes the form of a "quantum stochastic differential equation" in a Markovian 
limit. The controller, however, only has access to the observations of the probe. The 
laser probe itself contributes quantum fluctuations to the observations, hence the 
observation process can be considered as a noisy observation of an atomic variable. 

As in classical stochastic control we can use the properties of the conditional 
expectation to convert the output feedback control problem into one with complete 
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Fig. 1.1. A typical feedback control scenario in quantum optics. A probe laser scatters off a 
cloud of atoms in an optical cavity, and is ultimately detected. The detected signal is processed by a 
controller which feeds back to the system through a time varying magnetic field. 



observations. The conditional expectation TTt(X) of an observable X given the ob- 
servations {Y s : < s < t} is the least mean square estimate of X t (the observable 
X at time t) given Y s < t . One can obtain a quantum filtering equation |2JE1E1 that 
propagates Ttt(X), or alternatively the conditional density matrix pt defined by the 
relation TTt(X) — Tr[ptX]. This is the quantum counterpart of the classical Kushner- 
Stratonovich equation, due to Belavkin |2J, and plays an equivalent role in quantum 
stochastic control. In particular, as EX t = Eir t (X) we can control the expectations of 
observables by designing a state feedback control law based on the filter. 

Note that as the observation process Y s < t is measured in a single experimental 
realization, it is equivalent to a classical stochastic process (i.e. the observables Y t 
commute with each other at different times). But as the filter depends only on the 
observations, it is thus equivalent to a classical stochastic equation; in fact, the filter 
can be expressed as a classical (Ito) stochastic differential equation for the conditional 
density matrix pt- Hence ultimately any quantum control problem of this form is 
reduced to a classical stochastic control problem for the filter. 

In this paper we consider a class of quantum control problems of the following 
form. Rather than specifying a cost function to minimize, as in optimal control the- 
ory, we desire to asymptotically prepare a particular quantum state pf in the sense 
that EX t — > Tr[/3/X] as t — > oo for all X (for a deterministic version see e.g. \'2l\). 
As EXt — Eir t (X), this comes down to finding a feedback control that will ensure the 
convergence pt — > Pf of the conditional density p t . In addition to this convergence, 
we will show that our controllers also render the filter stochastically stable around 
the target state, which suggests some degree of robustness to perturbations. In 21we 
will discuss the preparation of states in a cloud of atoms where the z-component of 
the angular momentum has zero variance, whereas in jJS we will discuss the prepa- 
ration of correlated states of two spins. Despite their relatively simple description 
the creation of such states is not simple. Quantum feedback control may provide 
a desirable method to reliably prepare such states in practice (though other issues, 
e.g. the reduction of quantum filters [§] for efficient real-time implementation, must 
be resolved before such schemes can be realized experimentally; we refer to [7] for a 
state-of-the-art experimental demonstration of a related quantum control scenario.) 

Though we have attempted to indicate the origin of the control problems studied 
here, a detailed treatment of either the physical or mathematical considerations behind 
our models is beyond the scope of this paper; for a rigorous introduction to quantum 
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probability and filtering we refer to jS] . Instead we will consider the quantum filtering 
equation as our starting point, and investigate the classical stochastic control problem 
of feedback stabilization of this equation. In we nrs t introduce some tools from 
stochastic stability theory and stochastic analysis that we will use in our proofs. In 
S[3] wc introduce the quantum filtering equation and study issues such as existence 
and uniqueness of solutions, continuity of the paths, etc. In <2]we pose the problem 
of stabilizing an angular momentum eigenstate and prove global stability under a 
particular control law. It is our expectation that the methods of 21 arc sufficiently 
flexible to be applied to a wide class of quantum state preparation scenarios. As an 
example, we use in SjSJthe techniques developed in 2]to stabilize particular entangled 
states of two spins. Additional results and numerical simulations will appear in |2U| . 

2. Geometric tools for stochastic processes. In this section we briefly re- 
view two methods that will allow us to apply geometric control techniques to stochastic 
systems. The first is a stochastic version of the classical Lyapunov and LaSalle invari- 
ance theorems. The second, a support theorem for stochastic differential equations, 
will allow us to infer properties of stochastic sample paths through the study of a 
related deterministic system. We refer to the references for proofs of the theorems. 

2.1. Lyapunov and LaSalle invariance theorems. The Lyapunov stability 
theory and LaSalle's invariance theorem are important tools in the analysis of and 
control design for deterministic systems. Similarly, their stochastic counterparts will 
play an essential role in what follows. The subject of stochastic stability was studied 
extensively by Has'minskii fEI and by Kushner [12] ■ We will cite a small selection of 
the results that will be needed in the following: a Lyapunov (local) stability theorem 
for Markov processes, and the LaSalle invariance theorem of Kushner |15l 1161 IT7] . 

Definition 2.1. Let x\ be a diffusion process on the metric state space X , started 
at xq = z, and let z denote an equilibrium position of the diffusion, i.e. x\ = z. Then 

1. the equilibrium z is said to be stable in probability if 

limPf sup \\x z t - z\\ > e ) = Ve > 0. (2.1) 

\0<t<oo / 

2. the equilibrium z is globally stable if it is stable in probability and additionally 

p(]imxi = z)=l Vz e X. (2.2) 

\t— >oo / 

In the following theorems we will make the following assumptions. 

1 . The state space X is a complete separable metric space and xf is a homoge- 
neous strong Markov process on X with continuous sample paths. 

2. V(') is a nonnegative real- valued continuous function on X. 

3. For A > 0, let Q\ = {x e X : V(x) < A} and assume Q\ is nonempty. Let 
t\ = inf{f : x\ £ Q\} and define the stopped process x\ = a^ ATA - 

4. jz/\ is the weak infinitesimal operator of Xt and V is in the domain of s£\. 
The following theorems can be found in Kushner [151 1 1 (SI IT7) . 

Theorem 2.2 (Local stability). Let srf\V < in Q\. Then the following hold: 

1. limt^oo V(x*) exists a.s., so V{xf) converges for a.e. path remaining in Q\. 

2. P-limt_ >00 ^^V(X( ) = 0, so jtf\V(xf) — * in probability as t —* oo for almost 
all paths which never leave Q\. 

3. For z € Q\ and a < A we have the uniform estimate 

P ( sup V(x z t ) >a]=P[ sup V[xf) >a)< (2.3) 

\0<t<oo / \0<t<oc / a 
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4- IfV(z) = and V(x) 7^ for x ^ z, then z in stable in probability. 

The following theorem is a stochastic version of the LaSalle invariance theorem. 
Recall that a diffusion x\ is said to be Feller continuous if for fixed t, EG(xf) is 
continuous in z for any bounded continuous G. 

Theorem 2.3 (Invariance). Let srf\V < in Q\. Suppose Q\ has compact 
closure, x\ is Feller continuous, and that P(||x| — z|| > s) — > as t — > for any 
e > 0, uniformly for z £ Q\. Then x\ converges in probability to the largest invariant 
set contained in C\ = {x £ Q\ : £/\V(x) — 0}. Hence x\ converges in probability to 
the largest invariant set contained in C\ for almost all paths which never leave Q\. 

2.2. The support theorem. In the nonlinear control of deterministic systems 
an important role is played by the application of geometric methods, e.g. Lie algebra 
techniques, to the vector fields generating the control system. Such methods can usu- 
ally not be directly applied to stochastic systems, however, as the processes involved 
are not (sufficiently) differentiable. The support theorem for stochastic differential 
equations, in its original form due to Stroock and Varadhan [21], connects events of 
probability one for a stochastic differential equation to the solution properties of an 
associated deterministic system. One can then apply classical techniques to the latter 
and invoke the support theorem to apply the results to the stochastic system; see e.g. 
[T3"| for the application of Lie algebraic methods to stochastic systems. 

We quote the following form of the theorem |14l IT3"| . 

Theorem 2.4. Let M be a connected, paracompact C°° -manifold and let Xk, 
k = . . .71 be C°° vector fields on M such that all linear sums of Xk are complete. 
Let Xk = J2i X l k (x)di in local coordinates and consider the Stratonovich equation 

n 

x = x. (2.4) 

fc=i 

Consider in addition the associated deterministic control system 

xl=x (2.5) 

with u k € ^ , the set of all piecewise constant functions from R + to R. Then 

y x = {x u :ue W n } C W x (2.6) 

where W x is the set of all continuous paths from R + to M starting at x, equipped with 
the topology of uniform convergence on compact sets, and is the smallest closed 
subset of W x such that P({u> £ il : x.(ui) £ S^x}) = 1. 

3. Solution properties of quantum filters. The purpose of this section is to 
introduce the dynamical equations for a general quantum system with feedback and 
to establish their basic solution properties. 

We will consider quantum systems with finite dimension 1 < N < oo. The state 
space of such a system is given by the set of density matrices 

S = { P £C NxN : P = p*, Trp=l, p > 0} (3.1) 

where p* denotes Hermitian conjugation. In noncommutativc probability the space V 
is the analog of the set of probability measures of an iV-state random variable. Finite- 
dimensional quantum systems are ubiquitous in contemporary quantum physics; a 
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-x? = X (xt) + J2XkW> k (tl 



system with dimension N = 2 n , for example, can represent the collective state of n 
qubits in the setting of quantum computing, and N = 2 J + 1 represents a system 
with fixed angular momentum J. The following lemma describes the structure of S: 
Lemma 3.1. S is the convex hull of {p e £ NxN • p = V v* , v G C^, v*v = 1}. 
Proof. The statement is easily verified by diagonalizing the elements of V . □ 
We now consider continuous measurement of such a system, e.g. by weakly cou- 
pling it to an optical probe field and performing a diffusive observation of the field. 
When the state of the system is conditioned on the observation process we obtain the 
following matrix-valued Ito equation for the conditional density, which is a quantum 
analog of the Kushner-Stratonovich equation of nonlinear filtering [21 Pfl I10|: 

dp t = -i(H t p t - p t H t ) dt + {cp t c* - \(c*cp t + p t c*c)) dt 

+ Vv(cpt+Ptc* -Tr[(c + c*)p t ]pt)dW t . ( ' } 

Here we have introduced the following quantities: 

• The Wiener process W t is the innovation dW t — dy t — y/rjTr[(c + c*)p t ]dt. 
Here yt, a continuous semimartingale with quadratic variation (y,y)t = t, is 
the observation process obtained from the system. 

• H t = is a Hamiltonian matrix which describes the action of external forces 
on the system. We will consider H t of the form H t = F + utG with F = F*, 
G = G* and the (real) scalar control input u t - 

• u t is a bounded real cadlag process that is adapted to T\ = <j{y s , < s < t), 
the filtration generated by the observations up to time t. 

• c is a matrix which determines the coupling to the external (readout) field. 

• < rj < 1 is the detector efficiency. 

Let us begin by studying a different form of the equation 1)3.2(1 . Consider the linear 
Ito equation 

dpt = -i(H t p t - PtH t ) dt + {cp t c* - \{c*cp t + p t c*c)) dt + y/rj {cp t + p t c ) dy t , (3.3) 

which is the quantum analog of the Zakai equation. As it obeys a global (random) 
Lipschitz condition, this equation has a unique strong solution (j2H]; PP- 249-253). 

Lemma 3.2. The set of nonnegative nonzero matrices is a.s. invariant for 13. 3f) . 

Proof We begin by expanding po into its eigenstates, i.e. po = J2i ^i v o v o* with 
Vq G being the ith eigenvector and Xi the ith eigenvalue. As po is nonnegative all 
the Xi are nonnegative. Now consider the set of equations 

dp] = -i(H tP l - p\H t ) dt + {cp\c* - \{c*cp\ + p\c*c)) dt + (cpl + ptc*) dW[ (3.4) 

with Pq — Vqv" . Here we have extended our probability space to admit a Wiener 
process W t that is independent of y t , and W( — y/rjyt + \/l — r) Wt- The process p t 
is then equivalent in law to E[pj|jF t y ], where p' t = ^iPt- 
Now note that the solution of the set of equations 

dv l t = ~iH t v l t dt - \c*cv\ dt + c v\ dW[, v\ G C N (3.5) 

satisfies p\ — v\ v T i as i s readily verified by Ito's rule. By pp. 326 we have that 
v\ — UtVg where the random matrix Ut is a.s. invertible for all t. Hence a.s. v\ ^ 
for any finite time unless Vq — 0. Thus clearly p' t is a.s. a nonnegative nonzero matrix 
for all t, and the result follows. □ 

Proposition 3.3. Eq. (|3.2|l has a unique strong solution p t — pt/Tv p t in S. 
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Clearly this must be satisfied if (|3.2[) is to propagate a density. 

Proof. As the set of nonnegative nonzero matrices is invariant for p t , this implies 
in particular that Tr p t > for all t a.s. Thus the result follows simply from application 
of Ito's rule to (|3.3() . and from the fact that if M = J^. A;i>j is a nonnegative nonzero 
matrix, then Af/Tr M = Xj)vi g5. □ 



Proposition 3.4. The following uniform estimate holds for l|3.2|l : 



P [ sup W/h+s - p t \\ > £ < CA(1 + A) Ve > 

vO<5<A 



(3.6) 



where < C < oo depends only on e and \\ ■ \\ is the Frobenius norm. Hence the 
solution of (13.21) is stochastically continuous uniformly in t and po. 
Proof. Write pt — po + <&* + S t where 



-i(H s p s - p s H s ) + (cp s c* - i(c*cp s + p s c*c))] ds. 



(3.7) 



^ (cp s + p s c* - Tr[(c + c*)p s ]p s ) dW s . 



(3.8) 



For S t we have the estimate (pQ, pp. 81) 

»i+A 



E| sup ||a 4+ 5-c,t| 

\0<(5<A 



< 4?7 



E||cp s + p s c* - Tr[(c + c*)p s ]p s \\Us. (3.9) 



As the integrand is bounded clearly this expression is bounded by CiA for some 
positive constant C\ < oo. For $ t we can write 



E( sup ||$ t+5 

V0<5<A 





/■t+5 


2 


W+A 


2 




sup / ||G S || ds 


= E 


y \\Gs\\ds 


(3.10) 




0<<5<A Jt 









where G s denotes the integrand of (|3.7|) . As ||G S || is bounded we can estimate this 
expression by C 2 A 2 with C 2 < oo. Using \\A + B\\ 2 < 2(j|^4|| 2 + ||-B|| 2 ) we can write 



sup \\p t+ s-p t \\ 2 < 2 sup ||$ t+5 -$ t || 2 

0<5<A \0<<5<A 

Finally, Chebychev's inequality gives 



sup \\^t+s-^t\ 

0<S<A 



(3.11) 



P 



sup \\p t+ 5 - pt\\ > £ I < -sE I sup ||p t+5 - p t 



0<<5<A 



0<5<A 



2C 1 A + 2C 2 A 2 , 
< — - 2 — - — (3.12) 



from which the result follows. □ 

Remark. The statistics of the observation process yt should of course depend both 
on the control ut that is applied to the system and on the initial state po. We will 
always assume that the filter initial state po matches the state in which the system is 
initially prepared (i.e. we do not consider "wrongly initialized" filters) and that the 
same control ut is applied to the system and to the filter (see Fig. II. 1|) . Quantum 
filtering theory then guarantees that the innovation Wt is a Wiener process. To 
simplify our proofs, we make from this point on the following choice: for all initial 
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states and control policies, the corresponding observation processes are defined in such 
a way that they give rise to the same innovation process W% . 

We now specialize to the following case: 
• Ut = u{pt) with u e C 1 ^, R). 
In this simple feedback case we can prove several important properties of the solutions. 
First, however, we must show existence and uniqueness for the filtering equation with 
feedback: it is not a priori obvious that the feedback Ut — u(pi) results in a well- 
defined cadlag control. 

Proposition 3.5. Eq. (13.2(1 with u t — u(p t ), u e C 1 and p a = p e S has a 
unique strong solution p t = ipt(p,u) in S, and u t is a continuous bounded control. 

Proof. As S is compact, we can find an open set T C £ NxN such that S is 
strictly contained in T. Let C(p) : £ NxN — > [0, 1] be a smooth function with compact 
support such that C(p) = 1 for peT, and let U{p) be a C 1 (C NxN 1 R) function such 
that U (p) = u(p) for p £ S. Then the equation 

dp t = -iC(p t )[F + U(p t )G, p t ] dt + C(p t ){cp t c* - \{c*cp t + p t c*c)) dt 

+ C{p t )Vv {cpt + Ptc - Tr[(c + c*)pt]pt) dW u 

where [A, B] = AB — BA, has global Lipschitz coefficients and hence has a unique 
strong solution in £ NxN and a.s. continuous adapted sample paths [231 - Moreover 
pt must be bounded as C(p) has compact support. Hence Ut — U(pt) is an a.s. 
continuous, bounded adapted process. 

Now consider the solution p t of 1(3. 2(1 with u t — U(pt) and po — po S S. As both 
Pt and pt have a unique solution, the solutions must coincide up to the first exit time 
from T. But we have already established that p t remains in S for all t > 0, so pt can 
certainly never exit T. Hence pt = pt for all t > 0, and the result follows. □ 

In the following, we will denote by (fit (p, u) the solution of 1(3.2(1 at time t with 
the control ut — u(pt) and initial condition po = p e S. 

Proposition 3.6. IfV(p) is continuous, then EV(ipt(p,u)) is continuous in p; 
i.e., the diffusion ((3.2(1 is Feller continuous. 

Proof. Let {p n € S} be a sequence of points converging to p°° £ S. Let us write 
p™ = ipt{p n ,u) and pf — ipt(p°°,u). First, we will show that 

^\\P? - PTf ^ n^oo. (3.13) 
where || ■ || is the Frobenius norm (||^4|| 2 = (A ^4) with the inner product (A, B) = 



1 This is quite contrary to the usual choice in stochastic control theory: there the system and 
observation noise are chosen to be fixed Wiener processes, and every initial state and control policy 
give rise to a different innovation (Wiener) process. However, in the quantum case the system and 
observation noise do not even commute with the observations process, and thus we cannot use them 
to fix the innovations. In fact, the observation process yt that emerges from the quantum probability 
model is only defined in a "weak" sense as a * -isomorphism between an algebra of observables and 
a set of random variables on (H, T, P) 0- Hence we might as well choose the isomorphism for each 
initial state and control in such a way that all observations yt[po,v-t] give rise to the fixed innovations 
process Wt, regardless of po,ut. That such an isomorphism exists is evident from the form of the 
filtering equation at least in the case that ut is a functional of the innovations (e.g. if ut = u(pt)): 
if we calculate the strong solution of 13.21 given a fixed driving process Wt, po, and utfVl 7 ], then 
dyt = dWt + Tr[(c + c*)pt]dt must have the same law as yt[po,u-t]- 

Note that the only results that depend on the precise choice of yt[po,ut] on P) are joint 

statistics of the filter sample paths for different initial states or controls. However, such results are 
physically meaningless as the corresponding quantum models generally do not commute. 
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Tr (A*B)). We will write <5" = p™ — pf . Using Ito's rule we obtain 

Ell^ll 2 = II^H 2 + f ?/ETr ((cS: + S:c* - Tr[(c + c»? + Tr[(c + c*)p?]p?) 2 ) ds 
Jo 

+ f 2 E [Tr ((»[#, H{ft)\ - i[pf,H{pf)])5 n s ) + Tr {c5 n s c*5 n s - c*c(^) 2 )] 
Jo 

(3.14) 

where [A, B] = AB — BA. Let us estimate each of these terms. We have 
Tr (c*c(S?) 2 )=\\c5?f<C 1 \\S?\\ 2 



Ti(c5l l c*5f) = Wc,c%) < \\5?c\\ \\c5?\\ < C 2 \\6?f 

where we have used the Cauchy-Schwartz inequality and the fact that all the operators 
are bounded. Next we tackle 

Tr((fW,HW)]-i\p?,H(p?)])8?) < \m,H(p»)]-i\p?,H{p?)]\\ ||<5?||. (3.16) 

Now note that S(p) — i[p, H{p)\ = i[p, F + u(p)G] is C 1 in the matrix elements of p, 
and its derivatives are bounded as S is compact. Hence S(p) is Lipschitz continuous, 
and we have 

ii w) - s(p?)\\ < c 3 \\ P ? - P rw = c 3 \\sn (3.i7) 

which implies 

Tr ((i[p?,H(p?)] -i[p?,H(p?)})5?) < C 3 \\5?\\ 2 - (3-18) 

Finally, we have ||c<5™ + <5™c*|| < C4||<5™|| due to boundedness of multiplication with 
c, and a similar Lipschitz argument as the one above can be applied to S'(p) = 
Tr[(c + c*)p]p, giving 

\\K[(c + c*)p?}p?-Tr[(c + c*) P r} P r\\<C 5 \\6?\\. (3.19) 

We can now use \\A + B\\ 2 < \\A\\ 2 + 2\\A\\ \\B\\ + \\B\\ 2 to estimate the last term in 
(|3~T4) by C 6 ||<5 t ™|| 2 . Putting all these together, we obtain 

<■< 

xn\\2 s ||rni|2 , r< I nrll^™l|2. 



nw t r<\K\v+c / eii^ii^ s (3.20) 

and thus by Gronwall's lemma 

EPri| 2 <e Ct ||<5 i || 2 = e CT ||p"-p oo || 2 . (3.21) 

As t is fixed, Eq. lj3~T3) follows. 

We have now proved that p™ — > p^° in mean square as n — > oo, which implies 
convergence in probability. But then for any continuous V, V(p™) — > V(p%°) in 
probability (joj, pp. 60). As iS is compact, V is bounded and we have 

WV(p?) = E[P-hm W)] = I™ EV(p?) (3.22) 

n — >oo n — >oo 

by dominated convergence ([H], pp. 72). But as this holds for any convergent sequence 
p n , the result follows. □ 

Proposition 3.7. ipt(p,u) is a strong Markov process in S. 



Proof. The proof of the Markov property in [22], pp. 109-110, carries over to our 
case. But then the strong Markov property follows from Feller continuity JS]. □ 

Proposition 3.8. Let t be the first exit time of pt from an open set Q C S 
and consider the stopped process pf — </j tAT (p, u). Then pf is also a strong Markov 
process in S. Furthermore, for V s.t. x/V exists and is continuous, where srf is the 
weak infinitesimal operator associated to (pt(p,u), we have s/qV{x) = £/V(x) if x G Q 
and s$qV{x) = if x ^ Q for the weak infinitesimal operator s^q associated to pf . 

Proof. This follows from |15|. pp. 11-12, and Proposition ^. 41 □ 

4. Angular momentum systems. In this section we consider a quantum sys- 
tem with fixed angular momentum J (2 J S N), e.g. an atomic ensemble, which is 
detected through a dispersive optical probe |11|. After conditioning, such systems are 
described by an equation of the form (|3.2|) where 

• The Hilbert space dimension N — 2 J + 1; 

• c = /3F Z , F = and G = ~/F y with 0, 7 > 0. 

Here F y and F z are the (self-adjoint) angular momentum operators defined as follows. 
Let {ipk '■ k = . . . 2 J} be the standard basis in C^, i.e. ipi is the vector with a single 
nonzero element ip\ = 1. Then ^5] 

Fyip k = ic k _jip k+1 - icj-fcV'fc-i, 
F z tpk = (k - J)i>k 



with c m = I yj (J — m)(J + rn + 1). Without loss of generality we will choose (3 = 
7 = 1, as we can always rescale time and Ut to obtain any /3, 7. 

Let us begin by studying the dynamical behavior of the resulting equation, 

dp t = -iu t [F y , pt] dt - \[F Z , [F z ,p t ]] dt + ^j {F zPt + p t F z - 2 Tr[F zPt }p t ) dW t (4.2) 

without feedback u t = 0. 

Proposition 4.1 (Quantum state reduction). For any po € S, the solution p t 
of (|4.2|l with Ut = converges a.s. as t — > 00 to one of V'mV'm- 

Proof. We will apply Theorem 12.21 with Q\ — S. Consider the Lyapunov function 
v{p) = Tr[F z p] — (Tr[F z p\) . One easily calculates &fv(p) = —Arjv{p) 2 < and hence 

Ev(p t ) = v(p ) - 4r? / Ev( Ps ) 2 ds (4.3) 
Jo 

by using the Ito rules. Note that v(p) > 0, so 

477 f Ev(p s ) 2 ds = v{p ) - Ev(p t ) < v(p ) < 00. (4.4) 
Jo 

Thus we have by monotone convergence 

/>oo poo 

E / v{p s ) 2 ds < 00 / v{ps) 2 ds < 00 a.s. 

Jo Jo 



(4.5) 



By Theorem 12.21 the limit of v{pt) as i — * 00 exists a.s., and hence Eq. I|4.5|l implies 
that v(p t ) — > a.s. But the only states p that satisfy v(p) = are p = V'mV'm- ^ 
The main goal of this section is to provide a feedback control law that globally 
stabilizes (|4.2fl around the equilibrium solution (p t = Pf,u = 0), where we select a 
target state pf = VfV^ from one of Vf = tp m . 
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Stabilization of quantum state reduction for low-dimensional angular momentum 
systems has been studied in ^U]. It is shown that the main challenge in such a sta- 
bilization problem is due to the geometric symmetry hidden in the state space of the 
system. Many natural feedback laws fail to stabilize the closed-loop system around the 
equilibrium point pf because of this symmetry: the w-limit set contains points other 
than p f . The approach of uses computer searches to find continuous control laws 
that break this symmetry and globally stabilize the desired state. Unfortunately, the 
method is computationally involved and can only be applied to low-dimensional sys- 
tems. Additionally, it is difficult to prove stability in this way for arbitrary parameter 
values, as the method is not analytical. 

Here we present a different approach which avoids the unwanted limit points by 
changing the feedback law around them. The approach is entirely analytical and 
globally stabilizes the desired target state for any dimension N and < 77 < 1. The 
main result of this section can be stated as follows: 

Theorem 4.2. Consider the system (|4.2|l evolving in the set S. Let pf = VfV*^ 
where Vf is one of ip m , and let 7 > 0. Consider the following control law: 

1. ut = -Tr (i[Fy,p t ]pf) tfTr(p t p f ) > 7; 

2. u t = l ifTr(ptPf) < 7/2; 

3. If p t € B = {p : 7/2 < Ti(ppf) < 7}, then u t = -Tr (i[F y , p t ]pf) if Pt last 
entered B through the boundary Tr (ppf) = 7, and u t = 1 otherwise. 

Then 37 > s.t. Ut globally stabilizes (I4.2|l around pf and Ept — » Pf as t —>■ 00. 
Throughout the proofs we use the "natural" distance function 

V(p) = l-Tr(pp f ):S^[0 ) l] 

from the state p to the target state pf. For future reference, let us define for each 
a e [0, 1] the level set S a to be 

S a = {p e S : V(p) = a}. 

Furthermore, we define the following sets: 

{peS:a<V(p)< 1}, 
{peS :a<V(p) <l}, 
{peS :0< V(p) < a}, 
{peS :0< V(p) < a}. 

The proof of Theorem 14. 21 proceeds in four steps: 

1. In the first step we show that when the initial state lies in the set «Si, the 
constant control field u = 1 ensures the exit of the trajectories (at least) in 
expectation from the level set S\ . 

2. In the second step we use the result of step 1 to show that there exists a 7 > 
such that whenever the initial state lies inside the set 5>i_ 7 and the control 
field is taken to be u = 1, the expectation value of the first exit time from 
this set takes a finite value. Thus if we start the controlled system in the set 
iS>i_ 7 , it will exit this set in finite time with probability one. 

3. In the third step we show that whenever the initial state lies inside the set 
<S<i_ 7 and the control is given by the feedback law u(t) = — Tr (i[F y , pt\Pf), 
the sample paths never exit the set iS<i_ 7 /2 with a probability uniformly 
larger than a strictly positive value. We also show that almost all paths that 
never leave <S<i_ 7 /2 converge to the equilibrium point pf. 
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5>Q = 

S>a = 

S<a = 

S<a — 



4. In the final step, we prove that there is a unique solution p t under the 
control u f by piecing together the solutions with fixed controls u = 1 and 
u = —TY(i[Fy,p t ]pf). Combining the results of the second and the third 
step, we show that the resulting trajectories of the system eventually con- 
verge toward the equilibrium state pf with probability one. 

Step 1. Let us take a fixed time T > and define the nonnegative function 
x(p) = min £V((p t (p,l)), P e S. 

Recall that tpt(p, 1) denotes the solution of (|4.2|) at time t with the control it t = 1 and 
initial condition po = p. The goal of the first step is to show the following result: 
Lemma 4.3. x(p) <1 Vpe Si. 

To prove this statement we will first show the following deterministic result. 
Lemma 4.4. Consider the deterministic differential equation 



di Vt = [ ~ lFy 



F 2 z +CF z )v u i; o er\{0} 



(4.6) 



For sufficiently large C 3> 1, v t exits the set {v : v*Vf = 0} in the interval [0,T], i.e. 
there exists t £ [0, T] such that v^Vf ^= 0. 

Proof. The matrices F z and F y are of the form 



F z = 



*7 



Fy = 



0/ 



where F z has no repeated diagonal entries (F z has a nondegenerate spectrum) and 
the starred elements directly above and below the diagonal of F y are all nonzero. 
Now choose a constant k so that the matrix 



A 



-iF, - Ft 



kF, 



admits distinct eigenvalues. This is always possible by choosing sufficiently large k, 
as F z has nondegenerate eigenvalues and the eigenvalues of A depend continuously 2 
on k. For k £ {1, .., N} define the matrices Ak-i and Ak+i to be: 



Ak-i = [A 



J 1 < i ,j < A: — 1 ) 



Ifc+i = [A 



ij\k+l<i,j<N ■ 



The fact that the matrices [(-Fi)y]i<ij<fc-i and [(F z )ij]k+i<ij<N have different eigen- 
values then imply that for sufficiently large k the matrices Ak—i and Ak+i have disjoint 
spectra as well. 

Suppose that the solution of 

v = Av, v\ t=0 = v 

never leaves the set {v : v*Vf — 0} in the interval t £ [0,T]. Then in particular 



dt. 



-v*v f \ t = o = (A n v o yv f = 0, 



n 



0,1,. 



2 Note that the coefficients of the characteristic polynomial of A are continuous functions of k, 
and the roots of a polynomial depend continuously on the polynomial coefficients. 
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The matrix A is diagonalizable as it has distinct eigenvalues, i.e. A = PDP 1 where 
D is a diagonal matrix. Thus 

{D n v )*v f = 0, n = 0,l,... (4.7) 

where Uq = f Vo and t>/ = P*Vf. Eq. (|4.7I) implies that MSo = where 



M = 



( (v f )t 



(v f )* N D NN 
(vf)* N D 2 NN 



The determinant of this Vandermonde matrix is 

detM=(v f )* 1 ---(v f y N l[(D ti -D jj ). 

i>j 

As the matrix A has distinct eigenvalues, all the entries D\\, D 2 2, Dnn ar e differ- 
ent. Thus if we can show that all the entries of the vector if are non-zero then the 
matrix M must be invertible. But then Mvq = implies that Vq = and hence Vo = 
is the only initial state for which the dynamics does not leave the set {v : v*Vf = 0} 
in the interval t € [0, T], proving our assertion. 

Let us thus show that in fact all elements of if are nonzero. Note that 

(v f ) k = (p* Vf ) k = p; fc , 

so it suffices to show that the eigenvectors of the matrix A have only nonzero elements. 
Suppose that an eigenvector 5 of A admits a zero entry, i.e. 



AE = AS, 



Sfc = for some k 6 {!,.., N}. 



Defining Xk-i — [^j]j=i,..,k-i an d Xfe+i = [^j]j=k+i...,N, a straightforward computa- 
tion shows that due to the structure of the matrix A 



M-xXk-i = Axfe-i and A k+ iXk+i = Ax 



fe+i- 



But by the discussion above A k _\ and A k +\ have disjoint spectra, so S can only be 
an eigenvector if either Xfe-i = or Xfc+i = 0. 

Let us consider the case where Xk-i — 0; the treatment of the second case follows 
an identical argument. Let j > k be the first non-zero entry of 5, i.e. 



Si = Ha = ... = Hj_i = and Hj ^ 0. 



(4.8) 



As j4S = AS, we have that 
= A3j-_i = Aj-i t j- 2 Ej- 2 



Aj_ij_iSj_i +Aj-ijEj - Aj-xjEj 



<Fy) 



As (Fy)j-ij ^ this relation ensures that Ej = 0. But this is in contradiction 
with 14. 8f) and so S cannot admit any zero entry. This completes the proof. □ 

Proof of Lemma \4.ci\ We begin by restating the problem as in the proof of Lemma 
13.21 We can write tpt(p, 1) = pt/Trp t with p t = J2i ^i^-[ v t v t*\Ft), where A^ are convex 
weights and v\ are given by the equations 



dvl 



-iF y v\ dt - \Flv\ dt + F z v\ dW' t , v\ G C N \ {0}. 



(4.9) 
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Note that ETr[ip t (p, l)p f ] = iff ETr[p tPf } = £\ AiE^fp/uj] = 0. But as > 0, 

we obtain EV(<p t (p, 1)) = 1 iff v"vj = a.s. for all i. 

To prove the assertion of the Lemma, it suffices to show that there exists a 
t £ [0, T] such that EV(<fit(p, 1)) < 1- Thus it is sufficient to prove that 

3t e [0, T] s.t. ¥{v* t v f ^ 0) > (4.10) 

where v t is the solution of an equation of the form (|4.9|l . To this end we will use the 
support theorem, Thcorem l2.4l together with Lemma l4~4l 

To apply the support theorem we must first take care of two preliminary issues. 
First, the support theorem in the form of Theorem 12 . 41 must be applied to stochastic 
differential equations with a Wiener process as the driving noise, whereas the noise 
W[ of Eq. I|4.9|) is a Wiener process with (bounded) drift: 

dW[ = ^jdy t + ^/T^dWt = 2 V Tr{F zPt \dt + ^TjdW t + ^l^,dW t . (4.11) 

Using Girsanov's theorem, however, we can find a new measure Q that is equivalent 
to P, such that W[ is a Wiener process under Q on the interval [0, T]. But as the two 
measures are equivalent, 

3te[0,T] s.t. Q«w / ^0)>0 (4.12) 

implies <|4.1U|I . Second, the support theorem refers to an equation in the Stratonovich 
form; however, we can easily find the Stratonovich form 

dv t = -iF v v t dt - F*v t dt + F z v t o dW[ (4.13) 

which is equivalent to l|4.9|l . It is easily verified that this linear equation satisfies all 
the requirements of the support theorem. 

To proceed, let us suppose that (|4.12|l does not hold true. Then 

Q{ v ;v f = 0) = 1 Vt G [0,T]. (4.14) 

Recall the following sets: W Vo is the set of continuous paths starting at vq, and ,5f Vo 
is the smallest closed subset of W Vo such that Q({w S fl : v.{u>) S ^ }) = 1- Now 
denote by ,%] 0: t the subset of W Vo such that w t *f/ = 0, and note that ,% ,t is closed in 
the compact uniform topology for any t. Then (|4.14|) would imply that S^ Vo C ^v ,t 
for all t £ [0, T]. But by the support theorem the solutions of l|4.6|l are elements of 
S^voi and by Lemma l4~4l there exists a time t e [0, T] and a constant C such that the 
solution of H4.6|) is not an element of =% 0i t- Hence we have a contradiction, and the 
assertion is proved. □ 

Step 2. We begin by extending the result of Lemma f4. 31 to hold uniformly in a 
neighborhood of the level set 5i. 

Lemma 4.5. There exists 7 > such that x(p) < 1 ~ 7 f or a ^ P € <5>i r 

Proof. Suppose that for every £ > there exists a matrix p^ S 5>i_^ such that 

1 - £ < x(ps) < i- 

By extracting a subsequence \ and using the compactness of iS, we can assume 
that p^ n — > Poo G 5i and that x{P(, n ) ~ * 1- But by Lemma [4.31 yfo^) = 1 — e < 1. 
Now choose s e [0, T] such that 

EV(¥>.(poo,l)) = 1 -e. 
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Using Feller continuity, Prop. 13.61 we can now write 

1 = lim x(p( n ) < lim W(!p.(pt n ,l)) = EV(<p s ( Poo ,l)) = l-e<l. 

n — >oo n — >oo 

which is a contradiction. Hence there exists £ > such that x(p) < 1 — £ f° r &H 
p € <S>i_£. The result follows by choosing 7 = £/2. □ 

The following Lemma is the main result of the second step. 

Lemma 4.6. Let t (3 ( 1 S>i- 7 ) be the first exit time of ft(p, 1) from 5>i- 7 . Then 

sup Et p (iS>i_ 7 ) < 00. 



Proof. The following result can be found in Dynkin (|SJ, pp. Ill, Lemma 4.3): 

T 

Er p (5>i_ 7 ) < — — — . 

1 - sup ce5 P{r c (5>i- 7 ) > T\ 

We will show that 

sup P{t c (5>i_ 7 ) > T} < 1. (4.15) 

Ces 

This holds trivially for C e 5<i_ 7 , as then r^(5>i_ 7 ) = 0. Let us thus suppose that 

Ve > 3( e e S>i- 7 such that P{t Cc (5>i_ 7 ) > T} > 1 - e. 
Then for all s£ [0, T], we have that 

EV(^(Ce,l))>(l-e) inf V(p) = (l-e)(l- 1 ). 

pGo>i — , 

By compactness there exists a sequence e„ \ and Coo S 5>i_ 7 such that £ e7l — > Coo 
asn-^oo. Thus by Prop. lXBI 

EV( V .(Coo,l))>l-7 Vse[0,T]. 

But this is in contradiction with result of Lemma |4.5I Hence there exists an e > 
such that sup^gg P{r^(5>i_ 7 ) > T} = 1 — e, and we obtain 

EW^i-,)) < 1 _J l _ e) = ~ < 00 

uniformly in p. This completes the proof. □ 

Step 3. In this step we deal with the situation where the initial state lies inside 
the set iS<i-_ 7 . We will denote by u\(p) = — Tr (i[F y , p]pf) and by ipt{p,u\) the 
solution of l|4. 2J1 with po — p and with ut = u\(pt). Denote by si the weak infinitesimal 
operator of <fit(p, "i)- We will apply the stochastic Lyapunov theorems with Q\ = S. 

We begin by showing that there is a non-zero probability p > that whenever the 
initial state lies inside <S<i_ 7 the trajectories of the system never exit the set 5 <1 _ 7 / 2 . 

Lemma 4.7. For all p e 5<i- 7 



P 



sup V (ip t (p, tti)) > I-7/2 

0<t<oo 
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Proof. This follows from Theorem 12. 21 and srfV{p) — —Ui(p) 2 < 0. □ 

We now restrict ourselves to the paths that never leave <S<i_ 7 /2. We will first 
show that these paths converge toward pf in probability. We then extend this result 
to prove almost sure convergence. 

Lemma 4.8. The sample paths of <pt(p,ui) that never exit the set 5<i_ 7 /2 con- 
verge in probability to pj as t — > oo. 

Proof. Consider the Lyapunov function 

V{p) = l-Tt{ PPf f. 

It is easily verified that V(p) > for all p G S and that V(p) = iff p = pf. A 
straightforward computation gives 

^V(p) = -2 Ul (p) 2 Tr (j,p f ) - ir, (A/ - Tr ( P F Z )) 2 Tr ( PPf ) 2 < 

where A/ is the eigenvalue of F z associated to Vf . Now note that all the conditions 
of Theorem 12. 31 are satisfied by virtue of Prop. rT^l and rOl Hence tpt(p, Hi) converges 
in probability to the largest invariant set contained in C = {p G S : s/V(p) = 0}. 

In order to satisfy the condition srfV(p) = 0, we must have u\(p) 2 Tr (ppf) = as 
well as (A/ - Tr { P F Z )) 2 Tr {ppff = 0. The latter implies that 

either Tr (pp f ) = or Tr (pF z ) = X f . 

Let us investigate the largest invariant set contained in C = {p G S : Tr (pF z ) = Xf}. 
Clearly this invariant set can only contain p G C for which Tr (ip t (p, Ui)F z ) is constant. 
Using Ito's rule we obtain 

dTv( Pt F z ) = -iu 1 (p t )Ti([F y ,p t ]F z ) dt + 2^j(Tr(F 2 p t ) -Tv{F zPt ) 2 )dW t . 

Hence in order for Tr (jpt(p, u\)F z ) to be constant, we must at least have 



Tr (F 2 p) - Tr (F z pf 



0. 



But as in the proof of Prop. I4~T1 this implies that p — ^ m i/)^ for some m, and thus 
the only possibilities are V(p) — (for p = Vfvj) or V(p) = 1. 

From the discussion above it is evident that the largest invariant set contained 
in C must be contained inside the set {pf} U S\. But then the paths that never exit 
<S<i_ 7 /2 must converge in probability to P f. Thus the assertion is proved. □ 

Lemma 4.9. (pt{p,ui) converges to pf as t — > oo for almost all paths that never 
exit the set <S<i_ 7 /2- 

Proof. Define the event ^ > < 1 _ 7 / 2 = G ^ : '/'t(PjWi) never exits iS<i_ 7 /2}- 
Then Lemma 14 . 81 implies that 



p p 

<l-7/2 



pP 

<l-7/2 



lim P ( \\ip t (p, Ul ) - p f \\ > e 
By continuity of V, this also implies 

lim P (V(ip t (p,ui)) > 
As V(p) < 1, we have 

E(7(p*(p,tii)) |^!_ 7/2 ) <p(v(cp t (p, Ul ))>e 











Ve > 0. 



Ve > 0. 



<l- 7 /2 

V(y t {p,u-t)) > e 



pp 



Thus 



limsup E (V(<pt(p,Ux)) 
which implies 

lim E(v(tp t (p,ui)) 



But we know by Theorem 12.21 that V(<pt(p, mi)) converges almost surely. As V is 
bounded, we obtain by dominated convergence 



E 



( lim V(<p t (p,ui)) 



from which the result follows immediately. □ 

Step 4. It remains to combine the results of Steps 2 and 3 to prove existence, 
uniqueness and global stability of the solution p t . We will denote by u the control 
law of Theorem 14 . 21 and by tpt{p,u) the associated solution. Note that (pt(p,u) is not 
a Markov process, as the control u depends on the past history of the solution. We 
will construct ipt(p,u) by pasting together the strong Markov processes tft(p, 1) and 
tpt(p,ui) at the times where the control switches. 

Lemma 4.10. There is a unique solution ip t (p 1 u) for all t G R+. Moreover, for 
almost every sample path of ipt(p,u) there exists a time T < oo after which the path 
never exits the set 5<i_ 7 /2 and the active control law is u\. 

Proof. Fix the initial state p. We begin by constructing a solution (p t An(p,u) up 
to (at most) an integer time n G N . To this end, define the predictable stopping time 

t{ 1 = inf{i > : <p t (p, 1) G S<i_ 7 } A n. 

Then we can define p T ™ = ip T ™(p,l) and tptAn(Piu) = ipt{p, 1) for t < r™. In the 
following, we will need the two-parameter solution cp Si t(p, u') of the filtering equation 
under the simple control u' , given the initial state p at time s. Define 

er" = inf{i > r" : tp T n <t (p T n., u%) G S>i- 7 / 2 } A n. 

We can extend our solution by 

•£t/\n{p,u) = X t<T?<Pt(p, 1) +XT?<t«T?<PT?,t(Pr? * < °\ 

where \A is the indicator function on the set A. To extend the solution further, we 
continue again with the control law u — 1. Recursively, we define an entire sequence 
of predictable stopping times 

a'l = inf{i > t£ : ¥> T «,t(pr», Ui) G S>i_ 7 / 2 } A n, 
t£ = inf{t > al_ x : ip^^p^^l) G S<i- 7 } A n, 



where 
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We can use these times to construct the solution 



ip t An(P,u) = Xt<r?<Pt(p,l) + [XTZ<t«TZ<PTZ,t(PT£,Ui) +X<r%<t<T£ +1 'P<rZ,t{P<rZ> 1 ) 

k=l 

for all times t < E" — limfe_ >o0 a\\ < n (the limit exists, as ak is a nondecreasing 
sequence of stopping times.) Moreover, the solution is a.s. unique, as the segments 
between each two stopping times are a.s. uniquely defined. 

Now note that as anticipated by the notation, it is not difficult to verify that 
9ftA(n+i) 0°) u ) — ftAn(p, u ) a.s. for t < E", and moreover E™ = E A n, = Tk A n, 
a k = a k A n where E = lim^oo E™ etc. Hence we can let n — ► oo to obtain the 
unique solution tpt(p, u) defined up to the accumulation time E, where Tfc, ak are the 
consecutive times at which the control switches. It remains to prove that the solution 
exists for all time, i.e. that E = oo a.s. In particular, this uniquely defines a cadlag 
control u t , so that by uniqueness ipt(p, u) must coincide with the solution of (|3.2|) with 
the control Ut- Below we will prove that a.s., only finitely many ak are finite. This is 
sufficient to prove not only existence, but also the second statement of the Lemma. 

To proceed, we use the fact that the strong Markov property holds on each seg- 
ment between consecutive switching times r„ < t < a n or a n < t < r„+i. Thus 

P(<7„ < oo and r„ < oo) = 

J Xr„<oo(^) V((p t (p Tn {G)),Ui) exits 5 <1 _ 7 / 2 in finite time) P(du) 

which implies 

P(a n < oo | r„ < oo) = 

J P(<pt(p Tn (u>),Ui) exits <S><i_ 7 /2 in finite time) P(duj \ r„ < oo). 

But p Tn £ 5<i_ 7 on a set f2 Tn with P(f2 r „ I T n < oo) = 1. Hence by Lemma PT7I 

P(a n < oo | r n < oo) < 1 — p. 
Through a similar argument, and using Lemma 14.61 we obtain 

P(r n < oo | cr„_i < oo) = 1. 
But note that by construction 

P(t„ < oo | a n < oo) = P(<7„_i < oo | r n < oo) = 1. 

Hence we obtain 

P(<7„ < oo) P(t„ < oo I a n < oo)P(a n < oo) P(er„_i < oo | r„ < oo)P(r„ < oo) 
P(a„_i < oo) ~ P(t„ < oo) P(a n -i < oo) 

= P(a n < oo | r n < oo) P(r„ < oo | cr rl _i < oo) < 1 — p. 

But P(<Ti < oo) = P(ai < oo | t\ < oo) < 1 — p as t\ < oo a.s. Hence 

P(<7„<oo) < {l-p) n 
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and thus 



PK < oo) < £(1 - p) n = < oo. 

n=l n=l " 

By the Borel-Cantelli lemma, we conclude that 

P(er n < oo for infinitely many n) = 0. 

Hence S = oo a.s. and for almost every sample path, there exists an integer N < oo 
such that o~ n — oo (and hence also r n+ i = oo) for all n > N , and such that a n < oo 
(and hence also r„ + i < oo) for all n < N, which implies the assertion. □ 

Finally, we can now put together all the ingredients and complete the proof of 
Theorem O 

Proof of Theorem \4-2\ We must check three things: that the target state pf is 
(locally) stable in probability; that almost all sample paths are attracted to the target 
state as t — > oo; and that this is also true in expectation. Existence and uniqueness 
of the solution follows from Lemma f4. 101 

(i) To study local stability, we can restrict ourselves to the stopped process 

<PtAf(p, u) = <PtAf{p, u\), f = M{t : ip t {p, u) g 5 <1 _ 7/2 }. 

Denote by srf the weak infinitesimal operator of iptAf{p,ui), and note that Prop. 
13.81 allows us to calculate g/V from (|4.2(l in the usual way. In particular, we find 
£&V{p) = —ui(p) 2 < for p e 5 <1 _ 7 / 2 - Hence we can apply Theorem 12.21 with 
Qx = 5 <1 _ 7 / 2 to conclude stability in probability. 

(ii) From Lemmas 14.91 and 14. 101 it follows that tpt(p, u) — > pf a.s. as t — > oo. 

(iii) We have shown that 



E lim V(<pt(j>,u)) =V(p f )=0. 
But as V is uniformly bounded, we obtain by dominated convergence 
V (lim Eipt(j>,u)) = lim E [V(ip t {p, u))] = 

where we have used that V is linear and continuous. Hence Eipt{p,u) — > pf. □ 

5. Two-qubit systems. The methods employed in the previous section can be 
extended to other quantum feedback control problems. As an example, we treat the 
case of two qubits in a symmetric dispersive interaction with an optical probe field. 
Qubits, i.e. two- level quantum systems (having a Hilbert space of dimension two), and 
in particular correlated (entangled) states of multiple such qubits, play an important 
role in quantum information processing. Here we investigate the stabilization of two 
such states in the two-qubit system. 

We begin by defining the Pauli matrices 

0l\ / -i \ ( 1 

i o ) ' ^ = { i o ) ' az = { -1 

and we define the basis ip^ = (1 0)* and ip± — (0 1)* in C 2 . A system of two qubits 
lives on the 4-dimensional space C 2 ® C 2 with the standard basis {V'TT = V'T ® 
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y,z 



a x,y,z ® 1 and 



4>U = V'T®^, V'lT =^4.®^= = Vi®^}- We denote by (j\ 
ct^ y z = 1 ® a x,y,z the Pauli matrices on the first and second qubit, respectively, and 
by F XjVtZ = o~\ z + o~\ z the (unnormalized) collective angular momentum operators. 

The quantum filtering equation for the two-qubit system is given by an equation 
of the form (j3~i?j) : 



dp t = -iu\{t)[al, p t ] dt - iu 2 (t)[al,p t ] dt 

- \[F„ [F z , p t }} dt + yfq {F zPt + Pt F z 



2Tr (F zPt )p t )dW t 



(5.1) 



where u\ and u 2 are two independent controls acting as local magnetic fields in the 
y-direction on each of the qubits. The main goal of this section is two stabilize this 
system around two interesting target states, 



Here p s is a symmetric and p a is an antisymmetric qubit state. 
Theorem 5.1. Consider the following control law: 

1. ui(t) = 1 - Tr (i[o-l, p t ]p a ) , U 2 (t) = 1 - Tr p t ]p a ) if Tr (pp a ) > 7; 

2. ui(t) = 1, u 2 (t) = ifTr(p Pa ) < 7 /2; 

3. If p t G B a = {p : 7/2 < Tr (pp a ) < 7}, then take m(t) = 1 - Tr Pt]p a ) ; 
U2(t) = 1 — Tr Ptjpa) if Pt list entered the set B a through the boundary 
Tr (pp a ) — 7, and u\(t) — 1, U2(t) = otherwise. 

Then 3^y > s.t. (15.11) is globally stable around p a and Ept p a as t —> 00. Similarly, 

1. ui(t) = 1 - Tr pt]p B ) , u 2 (t) = -1 - Tr (i[a^, p t }p 8 ) i/Tr(pp s ) > 7; 

2. m{t) = 1, ua(t) = z/Tr(pp s ) < 7 /2; 

3. If p t eB s = {p: 7/2 < Tr (pp.) < 7}, ften take ui(t) = 1 - Tr (i[t^, p t ]p s ), 
it2(t) = — 1 — Tr Pt]Ps) i/ Pt tot entered the set B s through the boundary 
Tr(pp s ) = 7, and i«i(i) = 1, u 2 {t) = otherwise. 

stabilizes the system around the symmetric state p s . 

We will prove the result for the antisymmetric case; the proof for the symmetric 
case may be done exactly in the same manner. We proceed in the same way as in the 
proof of Theorem l4.2l 

Step 1. The proof of Lemma fOI carries over directly to the two qubit case. The 
proof of Lemma |4.4I also carries over after minor modifications; in particular, in the 
two qubit case we can explicitly compute that 

/0 



A = -ia\ - Fl 



2F Z = 



1 






-1 

-8/ 



admits the diagonlization A = PDP 1 with 



1 



P = 









1 

.1270 



1 

V2- 



D = 



1 












.1270 








-7.8730/ 






1 

7.8730/ 

Hence the matrix A has a nondegenerate spectrum and moreover 

P*(^u-^u) = ^^ -i -1 -1)* 

has only nonzero entries. The remainder of the proof is identical to that of Lemma l4.3l 
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Step 2. The proofs of Lemmas 14.51 and 14.61 carry over directly. 

Step 3. The proofs of Lemmas 14 . 71 and 14 . 91 carry over directly. The following re- 
places LemmaEO We denote by U\(p) = 1— Tr (a[o^ , p]p a ) , U 2 (p) = 1— Tr (i[(Ty,p]p a ) 
and by <pt(p, Ui, U 2 ) the associated solution of l|fl.ljl . 

Lemma 5.2. XTie sample paths of (ft(p,Ui,U2) that never exit the set 6><i f /2 

converge in probability to p a as t — ► 00. 

Proof. Consider the Lyapunov function 

V(p) = l-Tr(pp a ) 2 . 

It is easily verified that V(p) > for all p G 5 and that V(p) = iff p = p a . A 
straightforward computation gives 

^V(p) = -2 [(U^p) - If + (U 2 (p) - l) 2 ] Tr (pp a ) - AnTv {pF z f Tr (pp a f < 

where srf is the weak infinitesimal operator associated to <ft(p, U\, U 2 ) (here we have 
used [F y ,p a ] — in calculating this expression). Now note that all the conditions of 
Theorem l2.3l are satisfied by virtue of Prop. l3.6l and l3~4l Hence (fit(p, U\, U 2 ) converges 
in probability to the largest invariant set contained in C = {p € S : stfV(p) = 0}. 
In order to satisfy the condition s>/V(p) = we must have at least 

either Tr (pp a ) = or Tr (pF z ) = 0. 

Let us investigate the largest invariant set contained in C = {p € S : Tr (pF z ) = 0}. 
Clearly this invariant set can only contain p £ C for which Tr ((ft(p, Ui, Ui)F z ) is 
constant. Using Ito's rule we obtain 

2 

alTr ( Pt F z ) = -J2 Uj(pt) T r (*[*■£, Pt]F z ) dt + 207 (Tr (F z p t ) - Tr (F z p t f) dW t . 

Hence in order for Tr ((fit(p, Ui, U2)F Z ) to be constant, we must at least have 

Tr(F 2 p)-Tr(F zP ) 2 = 

which implies that p must be an eigenstate of F z . The latter can only take one of the 
following forms: either p = tp^ij)** or p = ip^ipT,, or p is any state of the form 

p = a^n^u + /^u^It + P^i^h + 0- - a )^i^h- ( 5 - 2 ) 

Let us investigate in particular the latter case. Note that any density matrix of the 
form 1)5. 2f> satisfies F z p = pF z = 0. Suppose that l|5.1|l with u\ = U\, u 2 = Ui leaves 
the set (|5.2ll invariant; then the solution at time t of 

4j.Pt = -i[Fy,Pt] (5.3) 

must coincide with tfti.Pi Ui^Ui) when p is of the form l|5.2jl . and in particular (|5.3|l 
must leave the set 1)5.211 invariant (here we have used that U\(p) = Uiip) = 1 for p 
of the form l|5.2(l ). We claim that this is only the case if p — p a , which implies that 
of all states of the form l|5.2|) only p a is in fact invariant. To see this, note that by 
Lemma 13. II we can write any p of the form l|5.2|l as a convex combination X^i/i 1 * 
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of unit vectors ip* € s P an {"0T.b V^it 1- Thus the solution of (|5.3|l at time t is given by 

E^iVfwith 

But Fyip 1 £ span{V>ti, VUt} unless ip 1 oc tp^ — tp^, which implies the assertion. 

From the discussion above it is evident that the largest invariant set contained 
in C must be contained inside the set {p a } U S\. But then the paths that never exit 
<S<i_ 7 /2 must converge in probability to p a . Thus the Lemma is proved. □ 

Step 4. The remainder of the proof of Theorem 15 . 1 1 carries over directly. 

Acknowledgments. The authors thank Hideo Mabuchi and Houman Owhadi 
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